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ABSTRACT 

ONEPHASE  is  a  computer  simulation  program  primarily  intended 
for  use  by  students  in  Biometry  or  Forest  Mensuration.  Using  real  or 
artificial  populations,  it  simulates  the  results  of  several  inventory  sam- 
pling techniques  using  several  regression  estimators  and  the  Horvitz- 
Thompson  estimator.  Both  volume  estimates  and  variance  estimates 
are  generated  and  the  results  are  displayed  for  comparison  and  anal- 
ysis. Parameters,  such  as  sample  size,  can  be  varied  among  runs  and 
their  influence  examined.  While  the  purpose  of  the  paper  is  to  pro- 
vide a  classroom  tool  and  not  necessarily  to  draw  conclusions  on 
management  implications,  managers  may  also  find  the  program  of 
use  in  weighing  alternative  inventory  methods. 


^Headquarters  is  in  Fort  Collins,  in  cooperation  with  Colorado  State  University. 
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Management  Implications 

The  computer  program  used  in  the  simulation  study 
by  Schreuder  et  al.  (1990)  compared  traditional  sampling 
strategies  with  model-based  procedures  and  emphasized 
results  of  interest  to  managers  who  must  select  among 
various  sampling  techniques.  It  was  modified  in 
Schreuder  and  Ouyang  (1992)  to  compare  only  design- 
based  sampling  designs  with  regression  estimators  and 
the  Horvitz-Thompson  estimator.  ONEPHASE  is  a 
simplified  version  of  that  modified  program  and  is  avail- 
able to  managers  for  simulations  on  their  own  popula- 
tions of  interest  and  for  classroom  examination  of 
sampling  designs  and  estimators. 

A  word  to  students  in  such  a  classroom  examination 
who  may  be  new  to  sampling,  statistics,  and  simulation: 
When  the  senior  author  was  taking  college  mathemat- 
ics courses,  publishers  of  textbooks  were  just  beginning 
to  include  answers  to  odd-numbered  problems  in  the 
back  of  the  book  and  computers  were  becoming  avail- 
able for  producing  answers  rapidly  and  accurately.  Both 
tended  to  enhance  the  perception  that  there  was  always 
one  right  answer.  Introductory  statistics  was  somewhat 
of  a  shock  as  ideas  of  sample  variances  impinged  on  that 
perception.  Then  knowledge  of  different  variance  for- 
mulas that  yielded  similar,  but  different,  results  obliter- 
ated it.  This  paper  is  intended  to  introduce  the  idea  that 
there  are  different  "answers"  in  forest  inventory,  and 
"the  right  one"  is  a  matter  of  objectives,  opinion,  and 
debate. 


Introduction 

In  computer  simulation,  we  have  the  luxury  of  know- 
ing "truth"  either  by  treating  large  survey  samples  as 
populations  or  generating  populations  with  known 
characteristics.  Thus,  we  can  simulate  inventorying  for 
some  parameter,  such  as  the  total  wood  volume  of  the 
population,  and  compare  the  inventory  estimates  with 
"truth."  This  allows  us  to  study  the  accuracy  and  pre- 
cision of  each  technique  relative  to  "truth"  and  examine 
the  variability  of  the  competing  estimates. 

Both  Mackisack  and  Wood  (1988,  1990)  and  Arvani- 
tis  and  Reich  (1989)  developed  related  sampling  tech- 
nique computer  programs  that  are  useful  in  classroom 
instruction  for  studying  the  effects  of  sampling  tech- 
niques. Both  techniques  rely  on  artificial  populations 
that  are  generated  by  user-specified  parameters  or  con- 
ditions. Schreuder  and  Ouyang  (1992)  used  several 
"live"  populations  with  different  characteristics  in  their 
study.  We  use  one  of  these  populations  for  illustration. 


All  are  available  with  the  ONEPHASE  program  for  fur- 
ther exploration. 

Snedecor  and  Cochran  (1967)  discussed  the  use  of 
regression  in  sampling,  particularly  with  reference  to  the 
measurement  of  more  than  one  attribute  or  variable  in 
a  sample.  In  such  cases,  one  variable  is  often  dependent 
on  another,  and  regression  can  be  used  to  predict  the 
dependent  variable  (usually  denoted  as  y)  from  the  in- 
dependent variable  (x).  In  our  data  sets,  the  parameter 
of  interest  is  volume.  Volume  is  difficult,  and  therefore 
costly,  to  measure.  However,  many  investigators  have 
observed  a  consistent  relationship  between  volume  and 
d2h,  where  d  is  the  diameter  at  breast  height  and  h  is 
height,  both  easily  obtained  measurements.  We  assume 
tree  diameter  and  height  are  known  for  the  entire  popu- 
lation, but  measurement  of  volume  is  on  only  the  sam- 
ple units  drawn  by  simulation.  The  regression  estimators 
then  predict  the  volume  of  the  entire  population.  While 
the  examples  are  all  based  on  the  volume/d2h  relation- 
ship, ONEPHASE  can  handle  any  dependent/independ- 
ent variable  relationship.  The  efficiency  of  sampling 
strategies  depends  on  the  underlying  relationship  be- 
tween such  variables. 


Portability 

ONEPHASE  is  written  in  FORTRAN  77,  with  two  ex- 
tensions that  are  widely  available  in  current  compilers; 
viz.,  variable  names  longer  than  6  or  7  characters  and 
the  STRUCTURE/RECORD  statements  that  allow  for  a 
more  structured  programming  style.  ONEPHASE  was 
programmed  for  use  on  personal  computers  (IBM  PC- 
compatible)  and  runs  successfully  when  compiled  in 
Microsoft  Fortran  5.0  and  in  MicroWay  NDP 
Fortran-486;  it  would  probably  compile  with  little  or  no 
difficulty  on  any  compiler  supporting  the  STRUC- 
TURE/RECORD statements.  The  program  could  be  con- 
verted to  strict  FORTRAN  77  standards  by  the  tedious, 
but  straightforward,  processes  of  editing  variable  names 
and  utilizing  COMMON  blocks  to  replace  the  STRUC- 
TURE/RECORD statements.  Copies  of  the  Microsoft  ex- 
ecutable version  for  the  PC/DOS  environment  or  of  the 
source  code  may  be  requested.  A  READ. ME  file  provides 
a  users  guide.  A  test  data  set,  input  parameter  file,  and 
corresponding  output  are  also  provided  on  the  diskette. 
The  DOS  version  of  ONEPHASE  allows  for  a  population 
size  of  2,000  in  the  input  file.  Time  required  is  depend- 
ent on  the  number  of  simulations  and  bootstrap  itera- 
tions: the  test  run  included  on  the  distribution  diskette 
is  small  (40  iterations,  200  bootstrap  samples)  and  re- 
quired 10.5  minutes  on  a  microcomputer  with  a  486 
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processor;  the  sample  output  shown  later  is  from  a  much 
larger  run  (10,000  iterations,  200  bootstrap  samples)  and 
took  13  hours  to  complete.  The  distribution  version  of 
ONEPHASE  will  run  without  a  coprocessor,  but  will  be 
slower. 


Simulating  Randomness 

The  heart  of  any  simulation  that  depends  on  "ran- 
dom" events  or  selections  is  the  random  number  gener- 
ator. Since  a  generator  that  always  produces  truly 
random  sequences  has  not  yet  been  developed,  nor  is 
very  desirable  because  replication  of  experimental 
results  would  be  impossible,  simulators  have  relied  on 
pseudorandom  number  generators  that  must  be  "seed- 
ed" to  produce  a  series  of  random  numbers.  In  the  1970's 
and  early  1980's  as  we  worked  on  time-sharing  main- 
frames, we  had  great  confidence  in  the  capabilities  of 
the  generators  we  utilized.  There  were  occasional  rum- 
blings from  the  theorists  about  "bad"  generators,  and 
we  were  cautious  to  limit  our  use  to  those  from  reputa- 
ble statistical  libraries  or  packages  rather  than  those 
provided  by  manufacturers  of  compilers. 

As  our  work  migrated  during  the  mid  to  late  1980 's 
to  the  increasingly  powerful  PC  environment,  we  found 
ourselves  in  search  of  portable,  nonproprietary  pseu- 
dorandom number  generators.  We  found  one  that  was 
simple  to  implement  in  FORTRAN,  validated  it  with 
some  simple  tests  for  "randomness"  (runs  up  and  runs 
down)  and  uniformity  (chi-square  or  Kolmogorov- 
Smirnov),  and  proceeded  with  our  simulation  study.  Our 
results  were  counterintuitive — sometimes  far  too  "good" 
and  most  often,  alarmingly  "bad."  The  underlying 
statistical  theories  were  checked  and  rechecked;  the 
FORTRAN  code  was  examined  and  results  were  repli- 
cated by  independent  code.  When  we  returned  to 
validating  the  pseudorandom  number  generator,  we 
found  that  we  had  fallen  into  the  cyclic  pattern  trap  so 
prevalent  in  PC  random  number  generators.  Our  earlier 
tests  had  behaved  satisfactorily  when  generating 
hundreds  of  thousands  of  pseudorandom  numbers.  Un- 
fortunately, we  were  now  generating  millions  of  them 
(this  is  primarily  due  to  the  use  of  bootstrap  methods 
for  variance  estimation);  reapplying  the  basic  tests  dis- 
closed that  we  had  indeed  reached  the  cyclic  limit,  and 
were  regenerating  the  same  sequences  of  "random" 
numbers. 

A  search  of  the  literature  revealed  increasing  interest 
among  theorists  that  still  has  not  peaked.  L'Ecuyer 
(1988)  discussed  flawed  generators  and  "periods  that  are 
too  short  to  be  used  safely  for  serious  applications."  He 
proposed  a  portable  generator  for  32-bit  computers 
which  required  that  we  work  in  double  precision  in  FOR- 
TRAN; we  found  it  to  be  somewhat  slow  because  of  the 
double  precision  (Microway's  NDP-486  compiler  han- 
dles the  32-bit  data  transfers  more  effectively,  so  the 
slowdown  was  not  as  perceptible),  but  it  did  pass  our 
basic  tests  even  when  we  generated  millions  of  random 
numbers.  The  generator  by  Kahaner  et  al.  (1988)  was 
recommended  to  us  at  about  this  same  time  and  it  also 


passed  all  of  our  basic  tests.  As  it  was  somewhat  faster, 
we  selected  it  as  the  generator  for  the  simulation  study. 

L'Ecuyer's  (1990)  more  recent  comments  indicate  that 
caution  is  still  the  byword;  but,  in  the  realms  of  interest 
to  us,  these  generators  are  probably  viable.  This  brief  dis- 
cussion is  not  to  explore  the  vagaries  of  pseudorandom 
number  generators,  but  merely  to  alert  the  user  to  the 
fact  that  the  choice  of  a  generator  can  adversely  affect 
the  results  of  a  simulation.  We  believe  that  the  one  chos- 
en for  the  simulation  study  performs  satisfactorily  for 
the  quantity  of  random  numbers  we  required.  We  recog- 
nize, however,  that  both  of  the  generators  we  examined 
probably  have  identifiable  periods  or  cycles  somewhere 
beyond  our  current  requirements,  and  that  if  we  were 
to  require  billions  of  random  numbers,  we  would  have 
to  retest  our  generators  and,  perhaps,  search  again  for 
an  acceptable  generator. 

Simulating  Sampling  Selection  Methods 

ONEPHASE  simulates  five  different  sampling  selec- 
tion methods:  (1)  Restricted  Simple  Random  Sampling 
(RSRS);  (2)  Sampling  Proportional  to  Size  from  Cumu- 
lated X's  (SPSCX);  (3)  Sampling  with  Probability  Propor- 
tional to  Size  (SPPS);  (4)  Stratified  Simple  Random 
Sampling  (STSRS);  and  (5)  User-Defined  Strata  (USER- 
DEF).  Two  variations  of  3)  are  also  simulated;  SPPS  with 
a  U-distribution  and  Modified  SPPS  (SPPSU  and 
SPPSMOD).  All  methods  are  described  below.  For  each 
method,  ONEPHASE  computes  5  separate  estimates  of 
volume,  four  regression  and  one  ratio  estimator;  these 
are  described  later.  For  each  estimate,  6  different  vari- 
ances are  computed.  As  mentioned  before,  we  assume 
for  illustration  purposes  that  we  are  interested  in  volume 
and  that  the  covariate  used  in  both  sample  selection  and 
estimation  is  d2h.  A  small  segment  of  the  complete  ex- 
ample output  (which  is  displayed  later)  below  shows  the 
5  volume  estimators  down  the  side  and  the  6  variances 
across  the  top.  The  symbols  displayed  in  the  output  will 
be  referenced  in  the  subsequent  sections,  which  discuss 
sampling  methods,  volume  estimators,  and  variances. 

VZ      VZl       VT      VT1     VB  VJ 
Ygr  92.4      94.8      93.9      88.3    79.5  103.2 

Ypi  78.9      81.0      80.5      77.7    91.8  114.1 

Ypiwr  1115  114-4  113-3  106-5  95-9  104-° 
Ywr        111.5    114.4    113.3    106.5    95.9  104.0 

Yht  98.4 

Sample  Selection  Methods 

Based  on  the  review  of  literature,  in  particular 
Schreuder  and  Ouyang  (1992),  the  following  sample 
selection  methods  are  compared: 

1.  RSRS  (Restricted  Simple  Random  Sampling) — 
Units  are  selected  randomly  from  the  entire  population, 
and  the  mean  and  variance  of  the  sample  are  compared 
to  the  population  mean  and  variance.  If  either  is  not 
within  the  user-specified  range,  the  sample  is  rejected 
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and  another  sample  is  selected.  By  making  the  specified 
range  sufficiently  large,  the  user  may  employ  this 
method  for  Simple  Random  Sampling  (SRS),  the  most 
basic  sample  selection  method.  We  employ  SRS  in  the 
example  output  by  specifying  a  wide  range  (±50%) 
around  the  population  mean  and  variance. 

2 .  SPSCX  (Sampling  Proportional  to  Size  from  Cumu- 
lated X's) — As  discussed  in  Schreuder  et  al.  (1990),  the 
population  is  ordered  by  ascending  values  of  x  and  strati- 
fied such  that  all  strata  have  identical  (or  as  nearly  iden- 
tical as  possible)  sums  of  the  xk  values.  One  unit  is  then 
randomly  selected  from  each  stratum  for  the  samples. 
The  user  specifies  the  value(s)  of  k  to  be  used. 

3.  SPPS  (Sampling  with  Probability  Proportional  to 
Size) — As  discussed  in  Li  et  al.  (1992),  the  population 
is  ordered  and  stratified  based  on  xk  such  that  certain 
properties  of  the  strata  are  optimized  for  sampling  pur- 
poses. The  sample  unit  (or  units)  for  each  stratum  is 
selected  such  that  the  larger  units  are  more  likely  to  be 
picked.  Randomness  still  plays  an  important  part  as  the 
xk  values  are  accumulated  in  random  order  and  the  first 
unit  exceeding  a  randomly  derived  target  value  is  the 
one  selected.  It  is  possible  in  a  given  stratum  for  a  unit 
that  is  much  larger  than  its  neighbors  to  be  selected  with 
certainty  on  every  sample.  ONEPHASE  accommodates 
such  a  case,  but  the  user  is  advised  to  be  aware  of  such 
anomalies  in  the  population.  The  user  specifies  the 
value(s)  of  k  and  the  number(s)  of  sample  units  to  be 
selected  from  each  stratum.  There  are  also  two  special 
cases  of  SPPS  sampling  considered  in  ONEPHASE: 

3a).  SPPSU  (U-distribution)— The  probabilities  of 
selection  are  computed  such  that  the  smallest  and  larg- 
est units  are  likely  to  be  selected,  while  the  middle 
units  are  less  likely  to  be  picked.  The  user  has  no  con- 
trol over  ONEPHASE 's  handling  of  this  sampling  tech- 
nique (k  is  always  1.0).  This  technique  is  more  fully 
detailed  in  Schreuder  and  Ouvang  (1992). 

3b).  SPPSMOD  (Modified  Sampling  with  Probabil- 
ity Proportional  to  Size) — The  only  difference  between 
this  sampling  technique  and  the  standard  SPPS 
method  is  the  guarantee  that  1/4  of  the  sample  units 
will  be  selected  from  the  smallest  units  in  the  popu- 
lation. The  subpopulation  of  small  units  set  aside  is 
1/2  the  sample,  and  the  guaranteed  selection  of  small 
units  is  done  by  simple  random  sampling  from  that 
subpopulation.  The  remainder  of  the  population  is 
then  sampled  by  SPPS.  The  user  may  specify  values 
of  k  in  this  technique. 

4.  STSRS  (Stratified  Simple  Random  Sampling) — The 
population  is  optimally  stratified  as  in  SPPS  above,  but 
sampling  is  by  simple  random  sampling  in  each  stratum. 
That  makes  this  method  similar  to  SPSCX  except  that 
the  strata  with  the  smaller  x-values  should  be  smaller 
and  those  with  the  larger  x-values  larger. 

5.  USERDEF  (User-Defined  Strata) — The  user  speci- 
fies the  number  of  strata,  the  number  of  units  to  be  as- 
signed to  each  stratum,  and  the  number  of  sample  units 
to  be  drawn  from  each  stratum  by  simple  random  sam- 
pling. For  example,  we  chose  to  have  3  strata  with  the 
first  and  last  strata  containing  a  certain  number  of  the 
smallest  and  largest  units,  respectively;  1/4  of  the  sam- 


ple was  drawn  from  each  of  them  and  the  other  1/2  of 
the  sample  was  drawn  from  the  large  middle  stratum, 
thus  guaranteeing  a  given  proportion  of  small  and  large 
units  in  the  sample. 


Estimators 

Five  estimators  are  utilized  in  ONEPHASE,  with  the 
first  four  being  regression  estimators.  The  first  estimate 
of  volume  displayed  in  the  output  segment  shown  earlier 
is  the  generalized  regression  estimator,  Yar  (Sarndal 
1980,  1982): 

K  =   t  7Ai  +  a*r  (N~t  +  K  (X-  I  Xj/tJ  [1] 

i  =  1  8       i  =  i  °l       i  =  i 

with  estimated  regression  coefficients 

agr=  12  YA^-b    t  Xi/friViW  t  [la] 
i  =  1  °i  =  l  i  =  l 

and 

n 

E  (Xj-xWK'Vj) 

b    =  ±*   [lb] 

gr  n 

i  =  l 

where 

n  =  sample  size 

Yj  =  dependent  variable  for  unit  i 

7Tj  -  probability  of  selecting  unit  i  (discussed  below) 

N  =  population  size 

Xj  =  independent  variable  for  unit  i 

n 
i  =  1 

vi  =  variance  for  unit  i,  usually  Vj  =  Xjk  (k  can  be 
user-specified,  we  use  1.5) 

x  =  JH£  x1./(ttivi) 
i  =  1 

y  =  N-^l  yi/(7r]vI) 

i  =  1 
i  =  1 

The  probability  of  selection,  iq,  is  dependent  on  the 
sampling  method: 

7Ti=  n/N  for  RSRS 
=  1/ris  for  SPSCX 

=  n^/Xg  for  SPPS  and  SPPSMOD 

=  n(xf  +  l/x^J/Xg*  for  SPPSU 

=  ns/Ns  for  STSRS  and  USERDEF 

where 

ns  =  sample  size  drawn  from  a  given  stratum 
Ns  =  the  given  stratum's  size 
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Xs=  E  xi 

1  =  1 

Xj*  =  Xj/  median  (x) 

N 

V  -  E  x*  +  l/x*i) 
i  =  1 

k  =  user-defined  parameter  as  discussed  in  (3)  SPSS 
above. 

The  second,  third,  and  fourth  estimators  shown  in  the 
output  segment  are  weighted  regression  estimators  Ypj, 
Ypiwr  and  Ywr,  respectively  (Schreuder  et  al.  1990).  All 
three  are  of  the  form 


wtregr    ^awtregr  +  ^wtregr^ 


[2] 


with 


CWgr  =  (  E  Yi/wi-h wtregr  E  Xi/wJ 1  E  1 lwd  [2al 
i  =  1  i  =  1         i  =  1 


wtregr 


i  =  1 

n 

E  X^/Wj 
i  =  1 

n 

-  E  yM 

i  =  1 

n 

E  Xj/Wj 
i  =  1 

n 

n 

E  Xf/W,-  - 

(  E  Xj/W,- 

i  =  l 

)2 

i  =  1 

i  =  1 

[2b] 


where  Wj  =  Tj  for  Ypi, 

=  irivi  for  Ypiwr,  and 
=  v-  for  Y  . 

Note  that  Ypi  considers  only  the  probability  of  selection, 
Ym  considers  only  the  estimated  variance,  but  ^iwr  con- 
siders both  the  probabilities  of  selection  [tt^)  and  vari- 
ance weights  (vj  =  Xjk)  in  estimating  the  regression 
coefficients  and,  in  fact,  its  regression  coefficients  are 
the  same  as  [la]  and  [lb]  above. 

The  fifth  estimator  shown  in  the  output  segment  is  the 
Horvitz-Thompson  estimator,  YHT  (Cochran  1977): 


i  =  1 

Variance  Estimators 


[3] 


The  first  two  variance  estimators  displayed  in  the  out- 
put segment  above  are  VZ  and  VZl,  suggested  by 
Ouyang  et  al.  (1992): 


vz(Yregr)  =  [  (N-n)  /  (Nn)  ]  [1/  (n-1)  ]  £  [{ny^  -%egrf 

i  =  l 

(Cumberland  and  Royall  1981). 

Sarndal  (1980,  1982)  proposed  two  variance  estima- 
tors for  Ygr:  VT  and  VTl  in  the  output  segment;  note  that 
for  comparison  purposes  we  have  used  these  variance 
estimators  for  Ypi,  Ypiwr  and  Y^  as  well. 

.2,    7r;7T,— 7r; 

n      7r,-7r,— 7T; 

where  ir{:  =  joint  probabilities  of  selecting  units  i  and  j, 


3  =  (Vj-y)  -b  (x-x) 


and 


e{  =  ere{{  [  (N-N)£  x}/[vF()  -  (X-X)  £x/  (W)  ]/Vi 

2=1  2=1 
+  [-(N-N)  I  Xtl  [VfTt)  +  (X-X)  £  1/  (7TfVf)  IVV;} 


n 


n 


n 


*!/{  E  Xf2/(7TfVf)i;i/(7rfVf)-[   Sxf/(7T^)]  } 

2=1  2=1  2=1 

n  n 
with  N  =  £  l/7rf  and  X  =  £  x^/irf 

Since  vt(Ygr)  and  vtl(Ygr)  vanish  for  sampling  schemes 
where  ir^  =  tt^  for  units  i  and  j  such  as  for  stratified 
sampling  with  one  unit/stratum,  alternatives  to  vt(Ygr) 
and  vtl(Y  )  are 


n 

-E 

i  =  1 

e2  + 

n 

E 

n 

=  E 

i  =  1 

e2  + 

n 

E 

eie/ 


which  for  7Tj7Tj  =  tt^  reduces  to 


vt(%r)  =.E  ei/7ri 


vzl(^regr)  =   E  (yj-a-bXj)2/^ 
i  =  1 


and 


vzi(^regJ  =  tE  (yra-bxjz/x?  ]  [n/(n-l)] 

i  =  1 


For  the  Horvitz-Thompson  estimator,  the  jackknife  var- 
iance estimator  VZ  is  displayed  and  is  calculated  by: 


vu(%r)  =  E  ef/Trf 

i  =  1 

(Schreuder  and  Ouyang  1992). 

The  last  two  variance  estimators  in  the  output  segment 
are  the  bootstrap  variance  (VB)  and  the  jackknife  vari- 
ance (VJ).  Efron  and  Tibshirani  (1991)  present  an  excel- 
lent general  discussion  of  the  bootstrap  for  the 
nonstatistician  and  Zahl  (1977)  similarly  describes  the 
jackknife.  Both  are  computed  for  only  the  first  four 


volume  estimates  Ygr,  Ygi,  Ypiwr  and  Y^;  in  the  follow- 
ing discussion,  we  let  Yregr  represent  any  of  the  four. 

In  bootstrapping,  from  the  sample  of  n  units  drawn 
from  the  population  by  any  of  the  four  methods,  nB 
bootstrap  samples  are  selected  by  simple  random  sam- 
pling (SRS)  with  replacement.  This  generates  nB  regres- 
sion estimates  Yre  .  If  these  regression  estimates  are 
denoted  generally  oy 

Wgv>b  =  1>  ■  ■  •  >nB 

then  we  can  compute  a  simple  bootstrap  variance 
estimate 

b  =  1 

where 

nB 

y(B)    =  V   y(b)  /n 
1  regr      L      regr' 1  B 
°     b  =  1 

In  jackknifing,  as  in  bootstrapping,  a  sample  of  n  units 
is  drawn  from  the  population  by  any  of  the  four  methods; 
then,  one  unit  at  a  time  is  deleted  from  that  sample  and 
the  regression  estimate  Yregr  is  recomputed  for  the 
reduced  sample  size.  If  these  n  jackknife  estimates  are 
denoted  in  general  by 

YrU)r,  j  =  1  n 

then  the  jackknife  estimates  (sometimes  called  pseudo- 
estimates  or  reduced  estimates)  are 

y(J]    =  nY     -  fn-1)  Y^ 

Aregr       XI1regr     ^       '  lregr 

and  the  variance  between  these  estimates  is  computed  as 


where 


Example  Output 

Included  below  are  the  results  for  one  of  the  popula- 
tions displayed  in  Schreuder  and  Ouyang  (1992).  Differ- 
ences between  the  results  displayed  here  and  in  that 
paper  should  alert  the  interested  user  to  the  fact  that 
computers  are  not  magically  correct  and  that  the  com- 
puter programs  themselves  may  yield  similar,  but  differ- 
ent, results  depending  on  programming  language  and 
style.  Efforts  were  made  to  make  the  results  comparable, 
but  differences  still  persist.  For  example,  starting  even 
a  single  program  with  different  random  number  gener- 
ator seeds  will  not  produce  identical  results.  Thus,  in 
the  simplification  of  the  earlier  program  to  produce 
ONEPHASE,  calls  to  the  random  number  generator  were 
performed  in  a  slightly  different  order,  resulting  in 
small,  but  discernable,  discrepancies. 

Because  our  purpose  is  the  comparing  and  contrast- 
ing of  different  methods,  estimators,  and  variances  in- 
stead of  actual  predictions  of  volumes,  we  chose  to 
express  the  output  in  percentages  relative  to  "truth." 
Both  the  simulation  bias  and  the  simulation  standard 
error  are  displayed  as  a  percentage  of  the  total  measured 
volume  of  the  population.  The  average  standard  errors 
of  estimates  are  stated  as  a  percentage  of  the  simulation 
standard  errors,  as  the  latter  are  our  best  measures  of  the 
actual  standard  errors.  ONEPHASE  first  displays  the  in- 
put parameters  and  then  displays  tables  of  percentages 
as  described  above,  plus  the  corresponding  confidence 
intervals. 


Output  for  Loblolly  Pine  Data  Set 

ONEPHASE  (version  05-06-91    11:06a).  Run:  15-MAY-91  15:46:58 

Output  file:  LOB. OUT 

Input  file:  D:  \  HANS  \  ONEPHASE  \  DATA  \  LOB81D1.SRT 

Input  format:  (Tll,Dl0.2,Tl,Dl0.2) 

No.  simulations:  10000 

Print  frequency:  10000 

No.  bootstrap  samples:  200 

Random  number  gen.  seed:  479233 

Sample  size:  20 

t  alpha  =     2.101,  deg.  freedom  =  18 

Rejection  criteria  for  RSRS  (mean):  50.000 

Rejection  criteria  for  RSRS  (variance):  50.000 

"variance  k"  for  WR:  1.50 

"stratum  k"  for  SPSCX:  1.00 

"stratum  k"  for  SPSCX:  1.50 

"stratum  k"  for  SPSCX:  0.50 

"stratum  k",  n(i)  for  SPPS:       1.00  1 

"stratum  k",  n(i)  for  SPPS:       1.50  1 

"stratum  k",  n(i)  for  SPPS:       1.00  20 

n(i)  for  STSRS:  1 
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k  for  SPPSMOD:  1.00 

Number  of  strata  for  "User-Defined  Strata":  3 

Strata  sizes  for  "User-Defined  Strata":       20  -1  20 

Sample  sizes  for  strata  in  "User  Defined  Strata":       5    10  5 


N:  1801,  £x:  21573.4, 
BIAS  STD 
%  ERR 

% 


Ly:  10700539.6  ,  No.  Simulations:  10000 
STD  ERR  FOR  CLASSICAL,  BOOTSTRAP 
&  JACKKNIFE  AS  %  OF  SIM.  STD  ERR 


CONFIDENCE  INTERVAL  PERCENTAGES 


RSRS 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 

SPSCX,  k 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 

SPSCX,  k 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 

SPSCX,  k 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 

SPPS,  k  = 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 

SPPS,  k  = 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 

SPPSU 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 

STSRS 
Ygr 
Ypi 
Ypiwr 
Ywr 
Yht 


100.2 
100.8 
100.3 
100.3 

99.9 
=  1.0 
100.0 
100.1 
100.4 

99.7 
100.0 
=  1.5 
100.0 
100.0 
100.5 

99.7 

99.9 
=  0.5 
100.0 
100.2 
100.3 
100.1 
100.0 

1.5,  i 
100.0 
100.0 
100.4 

99.6 
100.0 


100.0 
100.7 
100.4 
99.9 
100.0 

100.0 
100.2 
100.2 
99.2 
100.0 

100.0 
100.2 
100.3 
100.2 
100.0 


VZ      VZ1      VT  VT1 


VB 


VJ 


VZ 


VZ1      VT  VT1 


VB 


VJ 


4 

,6 

92. 

,4 

94, 

,8 

93, 

,9 

88.3 

79.5 

103.2 

86, 

2 

87, 

0 

86.7 

91.0 

93 

,4 

89.6 

4 

.4 

78, 

9 

81 

,0 

80, 

,5 

77.7 

91.8 

114.1 

80, 

5 

81, 

4 

81.2 

85.9 

92, 

,0 

90.7 

3 

.8 

111, 

,5 

114, 

,4 

113, 

3 

106.5 

95.9 

104.0 

87, 

2 

87, 

8 

87.6 

92.3 

93 

,4 

93.9 

3 

.8 

111, 

,5 

114, 

,4 

113, 

3 

106.5 

95.9 

104.0 

87, 

2 

87, 

8 

87.6 

92.3 

93 

,4 

93.9 

26 

,0 

98, 

A 

89, 

.3 

2, 

.9 

97, 

0 

99, 

,5 

95, 

.3 

95.2 

126.7 

115.6 

94, 

0 

94, 

,7 

93.6 

93.6 

93 

,2 

92.4 

2 

.9 

111, 

6 

114, 

,5 

100, 

,9 

100.8 

140.4 

140.3 

95, 

9 

96, 

,3 

94.5 

94.5 

92 

,0 

97.4 

3 

.0 

92, 

6 

95, 

,0 

90, 

,9 

90.9 

120.8 

106.9 

93, 

3 

94, 

0 

92.7 

93.0 

93 

,2 

95.9 

2 

,9 

95, 

8 

98, 

3 

93, 

,8 

93.8 

124.7 

122.1 

93, 

,5 

94, 

,2 

93.2 

93.3 

93 

,2 

95.9 

3 

.3 

123, 

9 

96, 

6 

3 

.6 

71, 

8 

73, 

,7 

70, 

.3 

70.7 

101.3 

163.2 

84, 

6 

85, 

6 

83.6 

83.2 

93 

,5 

90.9 

3 

,5 

95, 

9 

98, 

,4 

78, 

6 

79.4 

113.2 

208.5 

91, 

,7 

92, 

,3 

87.2 

86.8 

92 

,0 

96.4 

3 

.7 

69, 

,3 

71, 

,1 

67, 

8 

68.2 

97.7 

143.3 

83 

,5 

84, 

,5 

82.3 

82.3 

93 

.5 

93.8 

3 

.7 

94, 

0 

96, 

,4 

75, 

,6 

76.1 

98.8 

212.2 

89, 

,8 

90 

,4 

84.8 

84.8 

93 

.5 

97.1 

6 

,9 

228, 

9 

99 

,9 

3 

,2 

102, 

,4 

105, 

,1 

101, 

,2 

100.3 

114.5 

108.0 

94, 

,7 

95 

.2 

94.5 

94.6 

93 

.3 

92.7 

3 

.0 

102, 

.7 

105, 

,4 

101, 

,9 

100.5 

131.8 

120.3 

94, 

,2 

94 

,7 

94.1 

94.3 

92 

.1 

95.8 

3 

.0 

109, 

1 

111, 

9 

107, 

,8 

106.8 

121.9 

105.1 

94, 

.5 

95 

.0 

94.3 

94.5 

93 

.3 

95.8 

3 

,0 

103, 

1 

105, 

8 

102, 

,1 

101.1 

119.6 

108.4 

94, 

,1 

94 

,7 

93.9 

94.1 

93 

.3 

95.4 

3 

,4 

307, 

1 

100 

,0 

(i) 

1 

2 

.8 

102, 

3 

105, 

,0 

100, 

,6 

100.8 

130.8 

111.0 

95 

,0 

95 

,5 

94.7 

94.6 

93 

.3 

93.2 

2 

,8 

109, 

7 

112, 

,6 

104, 

,2 

104.6 

142.6 

127.6 

95 

,8 

96 

,2 

95.1 

95.1 

91 

.9 

97.2 

2 

,9 

99, 

0 

101, 

6 

97, 

,4 

97.6 

126.5 

105.6 

94 

,8 

95 

,3 

94.5 

94.5 

93 

.3 

95.8 

2 

.9 

95, 

6 

98, 

,1 

94, 

,4 

94.7 

124.3 

116.5 

93 

,2 

93 

,8 

92.9 

93.0 

93 

.3 

95.9 

3 

.3 

153, 

.1 

99 

,4 

(i) 

20 

3 

.2 

86 

,8 

89 

.1 

87 

,2 

91.0 

114.7 

121.7 

91 

.3 

91 

,9 

91.3 

91.9 

93 

.2 

92.5 

3 

.9 

78 

,6 

80 

,7 

70 

,8 

76.9 

101.9 

122.5 

89 

.8 

90 

.4 

87.4 

89.2 

92 

.3 

96.4 

3 

.3 

84 

,2 

86 

.4 

84 

.6 

88.2 

111.1 

117.4 

90 

.8 

91 

.5 

90.9 

91.5 

93 

.2 

95.2 

3 

.4 

81 

,1 

83 

.2 

80 

.8 

86.3 

106.4 

121.9 

90 

.0 

90 

.7 

89.6 

90.9 

93 

.2 

95.1 

3 

.8 

100 

,3 

94 

.0 

3 

.4 

95 

.1 

97 

.6 

96 

.1 

97.8 

107.0 

103.1 

92 

.3 

92 

.8 

92.5 

93.6 

93 

.3 

92.7 

3 

.6 

89 

.5 

91 

.9 

90 

.8 

92.7 

109.7 

109.5 

90 

.9 

91 

.7 

91.7 

92.9 

92 

.0 

95.0 

3 

.5 

93 

.1 

95 

.6 

94 

.1 

95.8 

104.7 

102.5 

91 

.6 

92 

.4 

92.0 

93.6 

93 

.3 

95.2 

3 

.8 

85 

.2 

87 

.4 

85 

.9 

87.5 

96.3 

104.7 

89 

.0 

89 

.9 

89.2 

90.6 

93 

.3 

93.8 

14 

.6 

98 

.7 

94 

.6 

3 

.2 

102 

.7 

105 

.4 

101 

.5 

100.7 

114.7 

108.4 

95 

.1 

95 

.5 

94.8 

95.0 

93 

.5 

92.9 

3 

.0 

102 

.8 

105 

.5 

102 

.1 

100.8 

131.7 

120.3 

94 

.5 

95 

.1 

94.4 

94.7 

92 

.0 

96.1 

3 

.0 

109 

.5 

112 

.3 

108 

.2 

107.3 

122.1 

106.0 

95 

.0 

95 

.5 

94.8 

95.1 

93 

,5 

96.0 

3 

.0 

103 

.2 

105 

.9 

102 

.2 

101.4 

119.5 

108.7 

94 

.6 

95 

.1 

94.4 

94.6 

93 

,5 

95.8 

3 

.4 

307 

,8 

100 

.0 

6 


SPPSMOD 


Ygr 

1UU 

n 
U 

o.o 

Ypi 

1  nn 
1UU 

n 
U 

O.D 

i  piwi 

1  nn 

1UU 

9 

O  .  Tt 

X  Wl 

1  nn 

1UU 

n 

u 

o .  u 

VVit 
i  n  i 

1  nn 

1UU 

n 
u 

O  .  D 

Ygr 

n  n 

99 

o 
O 

5.0 

Ypi 

99 

3 

5.1 

Ypiwr 

100 

1 

4.8 

Ywr 

95 

2 

3.4 

Yht 

100 

3 

30.4 
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97.7  102.9  107.2 
99.5  113.6  122.8 

102.3  107.6  105.7 

94.8  100.1  107.6 


89.4  73.3  112.8 
91.0  77.8  112.2 

91.5  74.9  111.5 
162.4  107.6  117.3 


93.5  94.0  93.2 
93.1  93.8  93.2 

93.6  94.3  93.4 

93.7  94.4  93.4 
100.0 

81.5  82.2  82.0 
80.9  81.7  82.3 
81.1  81.8  81.7 

78.6  79.5  77.0 
90.7 
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92.1 

83.9 
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Graphic  Displays 

Because  the  implications  are  not  readily  apparent  in 
tabular  output,  it  is  suggested  that  users  display 
ONEPHASE's  results  of  interest  in  graphs  such  as  figures 
1  and  2,  which  were  produced  by  a  proprietary  graph- 
ics software  package.  One  can  "see"  that  the  bootstrap 
variance  consistently  underestimates  the  variance  and 


the  jackknife  variance  consistently  overestimates  it,  but 
that  one  or  the  other  behaves  better  in  most  cases  than 
the  other  variance  estimators.  It  is  also  apparent  that  the 
sampling  method  is  critical  if  one  chooses  the  Horvitz- 
Thompson  estimator  instead  of  one  of  the  regression  es- 
timators. Such  conclusions  can  be  drawn  from  the  ta- 
bles, but  the  graphic  display  is  more  intuitive. 


Restricted  Simple  Random  Sampling 

(RSRS) 
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Figure  1 .  The  differences  among  the  variance  estimates  associated 
with  each  volume  estimator  for  a  single  inventory  method  (RSRS) 
are  displayed  graphically.  The  bootstrap  method  of  computing 
the  variance  estimate  is  observed  to  be  the  only  variance  com- 
putation that  consistently  mimicked  the  simulated  standard  error. 
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Contrasting  Sampling  Methods 

Classical  Variance  (VZ) 
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Figure  2.  A  single  variance  estimator  is  graphically  displayed  for 
all  volume  estimators  for  all  inventory  methods.  The  different 
regression  estimators  perform  better  across  all  inventory 
methods,  but  the  Horvitz-Thompson  estimator  fared  well  for  RSRS, 
STSRS,  and  SPPS1.5. 
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ONEPHASE  is  a  computer  simulation  program  primarily  intended 
for  use  by  students  in  Biometry  or  Forest  Mensuration.  Using  real  or 
artificial  populations,  it  simulates  the  results  of  several  inventory  sam- 
pling techniques.  Both  volume  estimates  and  variances  are  generated 
and  the  results  are  displayed  for  comparison  and  analysis. 

There  is  no  cost  for  this  computer  program.  However,  the  reques- 
tor must  provide  a  formatted,  double-sided,  double-density  or  high- 
density  "floppy"  (5  1/4"  or  3  1/2")  diskette  suitable  for  use  in  IBM 
personal  computers  (PC's)  or  compatibles,  and  enclose  a  self- 
addressed,  postage-paid  mailer  with  suitable  protection  for  the  dis- 
kette. Execution  of  ONEPHASE  requires  an  IBM-compatible  PC  with 
300K  of  available  memory.  For  further  information  write  Multi- 
resource  Inventory  Techniques  Research  Work  Unit,  Rocky  Mountain 
Forest  and  Range  Experiment  Station,  USDA  Forest  Service,  240  West 
Prospect  Road,  Fort  Collins,  CO  80526-2098. 

Keywords:  Computer  Simulation,  Classroom,  Forest  Inventory,  Biom- 
etry, Regression,  Horvitz-Thompson,  Bootstrap,  Jackknife  Estimation. 
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